"Wherever possible,   disaggregate data.     Provide  reports  on both aggregated
(and)  disaggregated data."

The second comparability  concern related to data  aggregation   is   identified by
The National Center for Research  in Vocational Education.     They point out  that:

"A...major problem the old VEDS   (Vocational Education Data System)
encountered was  the  varied and decentralized  nature  of  the  system  that
generated  the VEDS  reports.     The VEDS  forms were distributed  to  the states.
The information that was aggregated and reported  on  those   forms was
collected from local educational agencies by a variety of means.     A few
states  virtually  duplicated the VEDS forms and required the   local  agencies
to complete  them.     Some states  relied  on   individual  student records which
were  completed at the  local level  and aggregated at  the  state  level.     Most
states,   however,   tried to adopt their  existing information systems   to
supply  the  information required by VEDS.     The  success  of  this  approach
varied widely across  states."

The inference  drawn from these  comments ia  that the aggregate  data are   only as
good as the  source data.     If the source data are not comparable  then  the
usefulness  of  the  aggregate data is questionable.

The third issue   related to aggregation pertains  to the willingness  of   local and
state  education  agencies   to participate  in data collection efforts.     Hill
reviews  three   "factors  that lead state and local agency officials  to resist
federal data  collection efforts  or provide   low-quality responses" which lead to
data comparability problems.     The three factors Hill discusses  are
administrative burden,   federal presumptuousness,   and fear of  harm.     The  last
factor is discussed in terms of  avoiding enforcement actions  and avoiding
embarrassment.

Hill  offers  six suggestions  for reducing  "the severity  of  state  and  local
resistance:"

(1)    "That school districts will resist federal data  requests  less  if   they  see
fewer of  them"  and that  "complaints against   (the)   federal data  burden   could  be
significantly reduced by a greater use of   sample surveys."

(2)    That because  individual research firms are viewed as  being more   "interested
in doing  research"   than  in  "compliance  reviews"   and because  individual  research
firms  "can build reputations  for fairness  and professionalism,"   they  can   "get
far better  cooperation"  and results   "for  the  smaller  sample  surveys  and
exploratory studies."    He suggests that NCES   "make greater use  of  contractors  to
collect data."

(3)    That "school systems will contribute  more willingly... if   they  expect  to
benefit directly from the results."     Providing documents  that smaller districts
"could use  in reports  to their own school  boards  and the public"  are  actions
that could reduce  resistence.

(4)    That members   of Congress  tend to support their constituents   in conflicts
pertaining  to data collection.     He suggests  that  "the best way  to  reduce

81s are   the potential difficulties   facing  analysts
